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The vertex-cover problem is a prototypical hard combinatorial optimization problem. It was 
studied in recent years by physicists using the cavity method of statistical mechanics. In this paper, 
the stability of the finite-temperature replica-symmetric (RS) and the first-step replica-symmetry- 
broken (IRSB) cavity solutions of the vertex cover problem on random regular graphs of finite 
vertex-degree K are analyzed by population dynamics simulations. We found that (1) the lowest 
temperature for the RS solution to be stable, Tiis{K), is not a monotonic function of K, and (2) at 
relatively large connectivity K and temperature T slightly below the dynamic transition temperature 
Td{K), the IRSB solutions with small but non-negative complexity values are stable. Similar results 
are obtained on random Poissonian graphs. 

PACS numbers: 75.10.Nr, 89.20.Ff, 89.20.-a 



I. INTRODUCTION 

The vertex-cover (VC) problem, which asks to find a set of vertices of a graph such that the number of vertices in 
this set is less than a given value and that each edge of the graph is incident to at least one of the vertices in the 
set, is a prototype of NP-complete problems [l|, 0] with wide range of real- world applications [1, 0j @|- In the last 
ten years, the VC problem defined on the ensemble of large random graphs was extensively studied using mean-field 
spin glasses methods, especially the zero-temperature cavity method [a, S H, B It is found that, when the 

average connectivity c of the random graph is such that c < e ~ 2.71828 • • • , the random minimal vertex-cover (MVC) 
problem, which corresponds to vertex-covers of the minimal size for a given random graph, can be described by the 
replica-symmetric (RS) cavity theory. In this parameter range, minimal vertex-covers for a given random graph can 
be constructed using a leaf-removal algorithm [ll[ or by a simple message-passing warning propagation algorithm 
0. When c > e, the RS cavity theory is insufficient for the MVC problem, but the cavity theory at the level of 
first-step replica-^mmetry-breaking (IRSB) is still able to g ive accurate predictions on the average size of minimal 
vertex-covers 0, M, and the average ground-state entropy jl2j |. Following the zero-temperature IRSB cavity theory, a 
survey propagation algorithm was used in Ref. f§\ to construct minimal vertex-covers for single random graphs. 

Similar as the mean-field work on the random if-satisfiability problem [isl . 0, the zero-temperature cavity 
calculations of Refs. 0,i for the VC problem considers only the energetic effect and ignores completely the entropic 
effect. To have a more comprehensive understanding of the random VC problem, in the present paper a finite 
temperature T is introduced into the VC problem. The stabilities of the mean-field RS and IRSB cavit y so lution for 
the VC problem at finite temperature are analyzed following earlier works of Refs. [l^ [3 Hi [20l. l2ll. [2^ . The 
T ^ limit of these solutions and their stability are also studied. A similar analysis was recently carried out for the 
random Q-coloring problem by Krzakala and Zdeborova ■ The results reported in this paper suggest that the VC 
problem and the Q-coloring problem have some important differences. On random regular graphs with connectivity 
K, for the VC problem we find that the lowest temperature for the RS solution to be stable, Tfis{K), is not a 
monotonic function of K. The same non- monotonic behavior is observed for the VC problem on random Poisson 
graphs. We also find that, for random regular graphs with relatively large connectivity K, there is a temperature 
range TusiK) < T < Td{K) in which both a stable RS solution and a stable IRSB solution co-exist, where Td{K) 
is the dynamical transition temperature of the system. Although the VC problem is a spin-glass problem with only 
two-body interactions, the numerical results of this work suggest that, for random regular graphs with relatively large 
connectivity K and temperature T ~ Td{K), the IRSB cavity solutions with small but non- negative complexity values 
may be stable toward further steps of replica-symmetry-breaking. 

The paper is organized as follows. Section HIl includes some definitions. In Sec. IIIII we consider the RS solution and 
its stability. In Sec. IIVI we consider the finite temperature IRSB solution and its type-II stability. We also compare 
results obtained by the finite-temperature stability analysis with those obtained using both the energetic and the 
entropic zero-temperature stability analysis. We conclude this work in Sec. |Vl Some of the technical details are 
included in the two appendices of this paper. 
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II. DEFINITIONS 

Two ensembles of random graphs are considered in this paper, namely Erdos-Renyi (ER) random graphs (23j and 
regular random graphs. 

An ER random graph Q has N vertices and M — {c/2)N different edges, where the edges are chosen completely 
random from the set of N{N — l)/2 candidate edges between vertex-pairs. An edge of the graph which links between 
vertices i and j is denoted by (i, j). The vertex degree ki of a vertex i is equal to the number of edges that are linked 
to vertex i. The mean value of vertex degrees as averaged over all the vertices of graph Q is equal to c. For a large 
ER random graph, the fraction of vertices with a given degree k is given by the Poisson distribution fc{k) = e~'^c'^/fc!. 
Because of this reason, an ER random graph is also called a Poisson random graph. 

A regular random graph has N vertices and M = {K/2)N edges, with each vertex having exactly K edges. The M 
edges in a regular random graph are randomly connected under the constraint that each vertex has K edges attached. 

A vertex cover of graph Q is a subset of vertices U that covers all edges. Here, cover means that for each edge 
in the graph at least one of the two end vertices is in the set U. We denote the state of each vertex i by a Ising spin 
CTi G {±1}: cr.i = — 1 if i e [/ and ct^ = +1 if otherwise. All the vertex covers of graph Q form a solution sub-space 
out of the total number of 2^ possible spin configurations. Each vertex cover {ctj} = {cti, (T2, . . . , (Jn} is assigned an 
energy 

N 

E{{a,}) = Y,S,^.., (1) 

1=1 

which is equal to the cardinality of the vertex cover. 

We introduce a temperature T and weight each vertex cover by the Boltzmann factor e~^^, where /3 = 1/T is 
called the inverse temperature. The total partition function Z and the free energy F((3) are then defined by 

Z ^ e-^^(« ^ ^ ^-mW.}) -Q (1 _ S^^,,5^^,,) , (2) 

and the Gibbs measure for each vertex cover is 

T'aaJ)^ V'^^«-»n(l-'5^..i^^..i)- (3) 

In Eqs. (HI and ([3]), the term Wf^^ j){^~5ai,i5aj,i) is equal to unity or zero depending on whether the spin configuration 
corresponds to a vertex-cover or not. Only vertex-covers contribute to the free-energy of the system. The T ^ 
limit of Eq. ^ corresponds to the MVC problem. In this case, only those ground-state solutions have non-zero Gibbs 
measure. 

Under the Gibbs measure Eq. ^ the marginal probability tt^ of a vertex i being covered is expressed as 

{^,} 

-Ki is called the cover ratio of vertex i. A direct computation of the cover ratios tt^ is difficult for large random graphs, 
but approximate values for tt^ can be obtained using the cavity method. 



III. STABILITY OF THE REPLICA SYMMETRIC CAVITY THEORY 
A. The replica-symmetric cavity equations at finite temperatures 

According to the replica-symmetric cavity theory [2^ . the free energy at inverse temperature /? can be calculated 

by 

F(/?) = EAF,- A%,) , (5) 

where AFi and Ai^(jj) are, respectively, the free energy shift due to the addition of vertex i and edge The 
free energy expression Eq. ([5]) corresponds to the zeroth-order term of a loop series expansion for the total partition 
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function Eq. ^ ^2§\. The set of nearest-neighbors for a vertex i is denoted as di. Because of the locally tree-like 
structure of a random graph Q, in the absence of vertex i, the length of the shortest paths between two vertices j, k 
in the set di diverges logarithmically with the graph size N. It is then assumed that in the absence of vertex i the 
spin values on the vertices of the set di are mutually independent. Under this Bethe-Peierls approximation, the free 
energy shift associated with the addition of vertex i is expressed as 

AF, = -ilog(e-'^+ n^.K(/3)) , (6) 

where 'Kj\i{(3) is the probability of vertex j being covered in the absence of vertex i. In Eq. ([5]), the term e''^ 
corresponds to vertex i being covered [ai — —1), while the term Hjeai corresponds to vertex i being uncovered 
(then all the neighbors of i need to be covered). Under the same Bethe-Peierls approximation, the free energy shift 
Ai^(i j) is expressed as 

A%,) = -^log(l - (1 -7r,|,(/3))(l -7r,|,(/3))) . (7) 

The free energy F as expressed by Eq. (O is a functional of the 2M cavity probabilities two on each edge 

At equilibrium, the free energy F should reach a minimal value. Then the variational condition 

(8) 



leads to the following iterative equation for each cavity probability 7rj|j: 

where dj\i denotes the remaining set after vertex i is removed from set dj . When a fixed point is reached for the set 
of iterative equations Eq. the mean energy {E) and entropy S of the system are then calculated according to 

S = (3{{E)~F). (11) 

For a single graph Q, we denote by VRsi^^) the probability of observing a cavity probability with value = tt, 
namely 

-PRsi^) = ^ E {K^^m -^)+ - ^)) > (12) 

(i,i)6e 

where 5{x) is the Dirac delta function. When the size of a random graph Q is sufficiently large, the probability 
distribution P(7r) becomes independent of the detailed connection pattern of the graph. It only depends on the vertex 
degree profile of the graph and the inverse temperature (3. We can write down the following self-consistent equation 
for F(7r): 

7'Ks(^)=p„„(l)<5(7r-^— ) -K^p„„(fc + 1) / J][d7r,Pfls(^,-)]'^U^ ^ • (13) 

In Eq. (jl3p . Pnn{k + 1) is the probability that a randomly chosen nearest-neighbor of a vertex have vertex degree 
k + 1. 

For ER random graphs, Pnn{k + 1) = (fc + l)/c(fc)/c ~ fc{k), i.e., it is also a Poisson distribution. A fixed-point 
solution for Eq. p3p can be obtained by population dynamics simulation [24]. In terms of the cavity probability 
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FIG. 1: (Color Online) Mean vertex-cover energy density and entropy density as a function of the mean vertex degree of 
the ER random graph. Different curves correspond to different temperature T. The circular symbols are simulation results of 
Ref. [i]. 



distribution PRsiT^), the densities for the free energy, mean energy, and entropy can be re- written as 



f = F/N 



k=l 3 = 1 j = l 



+ 



2(3 



dniVRs{Tri)dTrjVRs{TTj) log(l - (1 - 7ri)(l - tTj)) 



^ {E)/N 
s = S/N 



m- 



fe=i ]=i 



nil 



(14) 

(15) 
(16) 



The mean energy and entropy density of the vertex-cover problem on ER random graphs of mean degree c < 2.7183 
are shown in Fig. [T] At a given value of /?, the mean energy density increases continuously with the mean vertex 
degree c. On the other hand, the mean entropy first increases with c when c is small and then decreases with c when 
c exceeds certain temperature-dependent value. 

For regular random graphs, p„„(fc + l) in Eq. (|13p is expressed as p„„(fc + l) = Sj^^^. In the replica-symmetric cavity 
theory, it is therefore assumed that the cavity cover ratio distribution VRsi"^) is a Dirac delta function VrsI'^) = 
(5(7r — TT*), with 7r» determined by 



The mean free energy density and energy density are calculated by 



ilog(e-'' + 7rf) + ;^log(27r,-^,2) , 



(17) 

(18) 
(19) 



B. The entropic zero-temperature limit 

The energetic zero-temperature limit of the RS cavity theory is very easy to implement. In this limit, one only 
interests in whether a given vertex is always uncovered among all the MVCs, and a warning propagation algorithm can 
be constructed for the vertex-cover problem in this limit [s'] . In this subsection, we study the entropic zero-temperature 
limit so that the entropy of MVCs can also be calculated. 
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It is helpful to define two auxiliary parameters r]i{/3) and rij\i{/3) through 



1 t^jKI/S) 



The physical meanings of rji and rjj^i are obvious: /3?7i = log[7ri/(l — tt^] is the log-likelihood of vertex i being covered, 
and Pr]j\i is the log-likelihood of vertex j being covered in the absence of vertex i. The iterative equation ([9]) can be 
rewritten as 

r7,|,(/3)--l+ ^logil + e-^^^u) . (22) 

kEdj\i 



At T ^ (/? — > +oo) we assume that 



r]j\, = mj|j -I- , (23) 



with rrij^i being an integer and rj|j being a finite real value. Then From Eq. (j22[) we get the iteration equations for 
rujii and rj\i: 



;i-e(|m,i,|))log(l + e-^''iO-e(-mfe|,)rfcj, , (25) 



where Q(x) is the Heaviside function defined by 8(x) = 1 for a; > and 8(x) = for a; < 0. 

At the limit of /3 ^ oo, the free energy Eq. p4|l . energy Eq. (fT5|) . and entropy Eq. (fT6l) can all be expressed in terms 
of {m^ii, From these expressions, the mean ground-state energy and entropy densities of the VC problem on an 

ER random graph can easily be evaluated by population dynamics. The theoretical predictions on the mean energy 
and entropy^density of the MVC problem are also shown in Fig. [Tl together with the simulation results of Weigt and 
Hartmann '6]. For mean connectivity c < 2.7183 the agreement between theory and simulation results is good. In the 
population dynamics simulation, we have noticed that when c > 2.7183, the amplitude of some rj|j values approaches 
infinity when mj|i = 0. Such type of divergence then lead to a negative value for the entropy density of the MVC 
problem (see also Ref. [l3|)- As we will discuss in the next subsection, for ER random graphs with c > 2.7183, the 
zero-temperature RS cavity theory is no longer valid and a more advanced mean-field theory is needed. 

We notice that, the divergence of the residue fields r^ij as observed for the random MVC problem does not occur 
in the random maximal matching problem [26| . For the random maximal matching problem, the RS cavity theory is 
stable at any temperature. 



C. Stability of the replica-symmetric solution 



At low enough temperatures and/or high mean vertex degrees, the Bethe-Peierls approximation used in the RS 
cavity equations is no longer valid. Then the RS cavity theory becomes unstable to higher levels of replica-symmetry- 
breaking. The stability of the RS cavity equations can be checked by studying the point-to-set correlations in the 
graph [23, m, ll^. If these correlations do not decay to zero at large distances, then non-trivial solutions exist for the 
one-step replica-symmetry-breaking (IRSB) cavity equations at Parisi parameter m = 1. The dynamical transition 
temperature Td, which is defined by the critical temperature where point-to-set correlation begin to diverge, can be 
checked using IRSB equations at to = l(see Appendix 1X1 for a detailed calculation oi Td). 

A easier way to check the validity of the RS assumption is to study the local stability of the RS solution. This local 
stability analysis leads to a threshold temperature Tfjs- However, the local stability of the RS solution is a necessary 
but not a sufficient condition for RS correctness and in general, Trs < Td. In this paper, the way of checking the 
local stability of the RS solution is to study the spin-glass susceptibility [H, [2^ as defined by 



(26) 
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FIG. 2: (a) RS local instability temperature Trs and dynamical transition temperature Td of the vertex-cover problem on 
regular random graphs (a) and ER random graphs (b). When T < Trs, RS solution become locally unstable; When T < Td, 
IRSB solution ai m — 1 has non-trivial solution. 



where {aiaj)c = i'^iO'j) — {(Ji){aj) is the connected correlation between vertex i and vertex j. The above equation can 
be re-expressed as 



XSG 



2 

TV 



(27) 



where Nd is the total number of vertex-pairs of distance (minimum path length) d in the graph Q] (Jj(d) denotes a 
vertex j which is separated from vertex i by a distance d; and {uiUj(^d))'i denotes the mean value of {(^iO'j(d))c 
averaged over all the Nd vertex-pairs (i, j) of distance d. For a large ER random graph with mean connectivity c, 
Nd — N{c'^/2) when d is much smaller than the length of a typical loop in the graph {d < log^N), while for a large 
regular random graph with vertex degree K, the scaling is Nd = NK{K ~ lY'-^/2. On the other hand, using the 
locally tree- like property of a random graph Q, it can be shown that 



(28) 



where 





2 |- 







l£d]\i,k 



n 



(29) 



In the above equation, the overline means averaging over all the paths A: — > j — > i of length two in the graph Q. 

For a regular random graph, the spin-glass susceptibility XSG remains finite in the thermodynamic limit of N - 
if and only if {K — l)A(/3) < 1. This condition is re-expressed as 



(K-l) 



(e-Z^ + Trf-i)^] 



< 1 



(30) 



where tt* is the solution of Eg. p?)) . 

The local stability boundary for the RS cavity theory as predicted by Eq. ([50)1 and the dynamical transition 
temperature Td are shown in Fig. [2^. At K — 2, the RS solution is locally stable at any temperature. When K > 3 
the RS solution is only stable at temperatures T > Tj^s- The critical temperature T^s is not a monotonic function 
of graph degree K but rather has a maximal value at K — 6. Such a re-entrant behavior is also observed for random 
ER graphs (Fig. ^jp). It is not yet clear why the RS solution of the VC problem on a random regular graph oi K = 6 
is the most easiest to be unstable. At small values of K, Td = Tus ■ But when K > 16, Td > Trs. The IRSB 
solution at TO = 1 (see the next section and Appendix [X| begins to have a non-trivial solution at T = Td, suggesting 
that the configuration space of the system starts to splitting into many Gibbs pure states. In the temperature region 
Trs < T < Td, although the RS solution still remains locally stable, it does not correctly describe the property 
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of the system. In our numerical solutions, we find that the Kauzmann temperature Tr-, which corresponds to zero 
complexity (S (m = 1) = 0, see next section), is always equal to Td- 

For an ER random graphs, the convergence condition for the spin-glass susceptibility XSG is cA(/3) < 1. For this 
ensemble of graphs, we can not determine the stability boundary analytically. Instead, we iterate a stability parameter 
Aj|j in population using population dynamics, where 

2 

A,K. (31) 

If Aj|j < 1 after iterating for a long enough time, the RS solution is then locally stable; otherwise it is locally 
unstable. The local stability boundary for the RS cavity solution is shown in Fig. [2b- When c < 2.7183 the RS 
solution is always stable and IRSB equation at m = 1 has trivial solution. When c > e, the RS solution is stable at 
high temperatures and becomes unstable blow a threshold temperature Trs{c). The threshold temperature Trs{c) 
has a maximal value at mean vertex-degree c ~ 20. Similar with those of regular random graphs, ~ Tjis at relative 
small average connectivity and becomes larger than Trs when c >= 30. 



jedz\f 



D. Infinite-connectivity limit 

When the connectivity (c for ER graphs and K for regular random graphs) is large, we see from Eq. ([9|) that 7rj|j 
should be very close to 1. In the case of regular random graphs, the solution at the K ^ oo limit of Eq. pT)) has the 
following property 

lim Trf = , lim tt^ = 1 . (32) 

K — >oc K — >oc 

At this limit, the free energy density and mean energy density both equal to unity, and the entropy density is zero. 
This means that when the connectivity goes to infinity, there is only one vertex cover for the graph which includes 
all the vertices. At K ^ oo, the local stability condition for the RS solution is 

lim 7r2^"-4 _ 1) e2/3 < 1 , (33) 

K—^oo 

which is satisfied at any finite temperature. Therefore the RS solution is locally stable at any finite temperature for 
an infinitely connected regular random graph. 

For ER random graphs, we do not have an analytical expression for the large c limit, but we have checked by 
population dynamics simulations that the results are the same as those in regular random graphs: the cover ratio 
and the energy density both go to unity, the entropy density goes to zero and the RS solution is locally stable at any 
finite temperature. 



IV. STABILITY OF THE FIRST-STEP REPLICA-SYMMETRY-BROKEN CAVITY SOLUTION 



A. IRSB solution at finite temperatures 



When the RS mean-field solution to the random vertex-cover problem is unstable, one can try to describe the system 
using the first-step replica-symmetry-breaking (IRSB) spin-glass theory. In the IRSB theory, the configuration space 
of the system is divided into many sub-spaces or macrostates. Each macrostate a has a free energy Fa{j3) and its 
contribution to the statistical property of the system is weighted by a Boltzmann factor exp(— ?/fQ,(/3)) , where y is the 
adjustable inverse temperature at the level of macrostates. The ratio m = y / (3 = yT is called the Parisi parameter. 
The grand free energy density (also called the replicated free energy density) g{y,(3) is defined as 

5(y,/3) = -^log(X^exp(-yF4/3))) = -]^log(/ d/e-^'^^+^^W)) , (34) 

where / denotes the free energy density of a macrostate and exp{NT,{f)) is the density of macrostates with free energy 
density /. The quantity S(/) is called the complexity. Taking the N oo limit, at saddle-point we have 



g(y,/3)=min[/-S(/)/2;] 



(35) 
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The macrostates with the lowest free energy density /o(/3) corresponds to the point of zero complexity, I](/o(/3)) = 0. 
Depending on the value of the parameter y (or equivalent the Parisi parameter m) the free energy density / of the 
macrostates which contribute to the grand free energy density g{y,(3) is determined by 



df 



(36) 



In the IRSB cavity theory, the order parameter is no longer the cover ratio ttj^^ but the distribution profile Qj\i{Trj\i) 
of vTjii over all the macrostates. Equation ([9]) is generalized into 



<3j|j(7''j|j) = J^lRSB{{Qk\]}) = 



kedj\i 



(37) 



where Zj^^ is a normalization factor, and the expression for A_Fj|j is 



AF_,-|,==--log(e-^ 



ked]\i 



(38) 

At given inverse temperatures /3 and y, a fixed-point solution {Qj\iiT^j\i)} of Eq. (|37p for a given random graph can 
be obtained by population dynamics. The corresponding grand free energy density g, mean free-energy density (/) 
(averaged over all the macrostates), and complexity can be obtained by the following equations: 



N ^ N ^ ^ ' 



S = V{{f) - 9) 



(39) 

(40) 
(41) 



In the above equations, AG; and AGy are, respectively, the shift of the grand free energy of the system due to the 
addition of a vertex i and an edge 



AG, 



AG,, = - 



■-^ jedi 
ilog[|d.,l 



d7rj|iQj|i(7rj|,)e' 



:d'^i\jQj\i{T^jli)Qi\j{'^2\j)e 



and (AFi) and (AF^ ) are, respectively, the mean value of the changes AFi and AFij over all the macrostates: 



(AF,) 



(AFy-) 



/n,g9,d7r,-|,Q,-|,(7r,-|,)AF,e-^^^' 
/n,ea,d7r,|,Q,i,(^,|,)e-^^AF. ' 

J dTTji,dTT,\jQji,{Trjii)Q,\j{TTnj)AF,je-y'^^'^ 

/ dTT J I j d TT, I J- Q J I j ( TTj- 1 , ) Q , I J ( TT, I J ) e - -P"' J 



(42) 
(43) 

(44) 
(45) 



To characterize the statistical property of the vertex-cover problem on a random graph, what we need is a distri- 
bution of the distribution Qj\i{TTj\i) among all the directed edges j —> i of the graph. Let us denote this distribution 
as ViRSBiQiT^)]- Similar to Eq. (fT^ we can write down the following self-consistent equation for VirsbIQ]- 



IRSB 



:Q(7r)] =P„„(l)<5(Q(7r)-(5(7r- 



\RSB{Qj)\^ \ Q{t^) - ^1RSb{{Qj}) 
k=l j=l \ / 



(46) 

For graphs with a general vertex degree distribution, Eq. (|46p can be solved numerically by population dynamics on a 
two-dimensional array (see, e.g., Ref. fso'l). In the special case of random regular graphs, the probability distribution 
'P\rsb[Q\ has a simple form: 'Pi7?5s[Q(7r)] = b {Q{tt) — Qc (tJ"))- Then Eq. (|^ can be re-written as a self-consistent 
equation for a single probability function QdTr), and the numerical task is much simplified. 
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B. IRSB Stability analysis 

The stability of the IRSB cavity solution is analyzed in the solution space of the second-step replica-symmetry- 
breaking (2RSB) cavity theory. In the 2RSB cavity theory, for each directed edge j ^ i the order parameter is the 
distribution of Qj\i{Trj\i) over all the domains of macrostates, which is denoted by The iteration equation for 

this distribution reads 

= U DQkyQku[Qku]e-«'^''^^'S{Q-TiRSB{{Qku})) (47) 



^J\^ 

--J I 



k^dj\i 



where is a normalization constant, ?/2 is the inverse temperature at the level of domains of macrostates, and 
AGk\j is expressed as 



AGkU = --\og[f II dn,^jQ,y{7r,^j)e-y^^''ij . (48) 



k£dj\i 

If on each directed edge j i the iteration equation Eq. (f47|) converges to the fixed-point solution Qj|i[Q(7r)] = 
S(Q{tt) — (5j|i(7r)), then the IRSB solution is said to be stable toward further steps of replica-symmetry-breaking. 

According to Refs. [20, 21, 31], there are two types of instabilities the IRSB cavity solution Eq. (l37|) can show toward 
non-trivial 2RSB solutions. The first type of instability (type-I instability) is state aggregation: the IRSB macrostates 
aggregate into 2RSB domains, while they themselves as described by Eq. p7|) contain no further internal structures. 
The type-I instability can be studied by tracing the propagation of a small perturbations to the distribution Q {Trj\i) 
during the IRSB iteration. But in practice it is rather difficult to implement such a check since the distribution 
Qjliijr) has to be represented by an array in the numerical population dynamics simulation. In this paper, the 
type-I instability analysis is performed only at zero temperature for the energetic cavity solution but not at finite 
temperatures. 

The second type (type-II) instability is state fragmentation: a IRSB macrostate is itself composed of many sub- 
macrostates. Numerically, this type of instability can be studied by tracing the propagation of a small perturbation to 
tTjIj during the IRSB iteration. The easiest way to do this is the deviation of two replicas method [3, [s^l. One first 
iterates the IRSB population dynamics to reach a steady state, and then creates a replica of the whole population and 
gives a small perturbation to each Tr^j value of the origin population. These two populations are then updated using 
the same sequence of random numbers for a sufficiently long time. If the difference between the two populations decays 
to zero with time, then the IRSB cavity solution is type-II stable. Another method of checking typc-II stability is 
noise propagation: we binds a noise Xj\i to each irj^i in the population. Then we iterate the population using Eq. (|37|) 
until a steady state is reached. At the same time, the values of Xi|i's are updated using Eq. (PT|) . If J2jXj\i is 
decreasing with iteration (equivalently, J2j Xj\i < 1 finally), then the IRSB iteration is stable. We have checked both 
methods and find that they always give the same result. 



1. The case of random regular graphs 

Figure [3] shows the phase diagram for the random regular graph VC problem with connectivity K — 5. When 
temperature T > T^siK = 5) = 0.358 the RS solution is stable. When T < Tfjs(5) the RS solution becomes unstable 
and Td — Tk — T^s- The IRSB solution is type-II stable only when the Parisi parameter m is sufficiently large. On 
the other hand, the physically meaningful values of m < m*, which correspond to T,{m) > 0, are all in the type-II 
unstable region (the value m* with S(rn*) = as a function of T is shown by the dotted line in Fig. [3]). Therefore for 
K = 5 the IRSB cavity solution is insufficient to describe the statistical physics property of the VC problem. The 
same qualitative results are obtained for random regular graphs with K = 10 (see Fig.U]). 

Figure [5] shows the phase diagram for the random regular graph vertex-cover problem with connectivity K — 20. 
At this connectivity we obtain results that are qualitatively different from the results obtained for K — 5 and 10. 
The RS mean-field solution is locally stable when temperature T > Tusi^O) — 0.2674. In this case, however, the 
dynamical transition temperature T(i{K), which is determined as the maximal temperature at which a nontrivial 
IRSB solution at to = 1 exists, does not coincide with Tjis{K). For K = 20, Td{20) = 0.2793, and in the temperature 
range Tjjs(20) < T < Td{20), non-trivial IRSB solutions for the VC problem exist if the Parisi parameter m is beyond 
the boundary line between the white and the gray region of Fig. [5l This result indicates that, in this temperature 
range, IRSB solution and RS solution are both stable. However the existence of a non-trivial IRSB solution at m = 1 
indicates that the RS solution is in fact not the physically meaningful one, as it does not describe the structure of the 
configuration space correctly. 
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FIG. 3: (Color Online) Phase diagram of the IRSB solution of the vertex-cover problem on random regular graphs with vertex 
degree K = 5. When T > Trs{5) = Td{5) — Tk{5) ~ 0.358 the RS mean-field solution is stable (the shaded region) and 
IRSB solution a,t m — 1 has only a trivial solution; when T < Tfis(5), the IRSB solution is type-II stable only when the Parisi 
parameter m is located above the solid line which connects the circular symbols. The values of the Parisi parameter m — m* 
which corresponds to zero complexity and hence the dominating macroscopic states are given by the dotted line. In this case, 
m* is always located in the type-II unstable region. The dashed line represents the curve m = yiT, where yi is the maximal 
value of y for which the IRSB zero-temperature energetic cavity solution is type-I stable. 
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FIG. 4: (Color Online) Same as Fig. O but for random regular graphs with vertex degree K — 10. 
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FIG. 5: (Color Online) Same as Fig. O but for random regular graphs with vertex degree K = 20. For T > Trs(2Q) = 0.2674 
the RS mean-field solution is locally stable, while for T < Td{20) = Tk{20) — 0.2793 a non-trivial IRSB mean-field solution 
appears at m = 1. Notice that Td{20) > Trs (20). The boundary line (which connected the -I- symbols) between the white and 
the shaded regions marks the minimal value of m below which the IRSB solution has no non-trivial solutions. The insert is an 
enlarge of the main figure. 




FIG. 6: (Color Online) Complexity and mean free energy density at T = 0.2703 for the VC problem on regular graphs with 
vertex degree K — 20. 
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FIG. 7: (Color Online) Phase diagram of the IRSB solution of the VC problem on ER random graphs of mean vertex-degree 
c — 10. The RS solution is stable for temperature T > Trs — Td — Tk ~ 0.25. For this system the energetic zero-temperature 
IRSB solution is type-I stable for y >0. 

As an example, for K = 20 and T — 0.2703, the complexity and the free energy density of the IRSB solution of 
the VC problem are shown in Fig. [6] as a function of the Parisi parameter m. When m < 0.8459, the IRSB solution 
reduces to the RS solution, which has free energy density //jg « 0.80006. A non-trivial IRSB solution emerges for 
771 > 0.8459 and this IRSB solution becomes type-II stable when m > 0.9108. The complexity is a decreasing function 
of m in the type-II stable region and it reaches zero at to = 0.9486 (correspondingly, the free energy density of the 
dominating IRSB macroscopic states is Jirsb ~ 0.80008). Therefore the IRSB free-energy density is only slightly 
larger than the RS free-energy density. For the whole temperature range Trs(20) <T < Td{20) we have checked that 
the free energy density of the RS solution and that of the IRSB solution at ni — m*{T) are always very close to each 
other. 

Figure [5] also demonstrates that, when the temperature T is higher than 0.15, the line m*{T), which corresponds 
to the dominating macroscopic states at each temperature, is located in the IRSB type-II stable region. If the IRSB 
solution is also type-I stable at m « m*(T) (which we have checked to be the case only for T = 0, see the dashed line), 
then for T > 0.15 the VC problem can be sufficiently described by the IRSB solution without the need of further 
steps of replica-symmetry-breaking. Further work is obviously needed to study more closely the VC problem near the 
temperature TusiK). For very low temperatures, however, the IRSB solution will become type-II unstable. 

2. The case of random Erdos-Renyi graphs 

Simulations on random ER graphs are technically more difficult, and therefore we have studied only the cases of 
mean vertex degree c—b and c ~ 10. For the case of c = 5, results similar to Fig. [3] and Fig. [4] are obtained. The 
results for the case of c = 10 are shown in Fig. [71 For this system, the IRSB solution at to = m*{T) is type-II stable 
when T > 0.20. 



C. The stability thresholds of the zero-temperature energetic and entropic IRSB cavity solution 

As a check of the finite-temperature results, here we compare the low-temperature results with the results obtained 
directly at T = 0. At the zero temperature limit, two types of IRSB solutions can be written down. The energetic 
IRSB solution 0, which neglects all the entropic effect of the VC problem, is much simplified. Both the typc-I 
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and type-II stability analysis of this solution can be performed. In this work, the type-II stability analysis is carried 
out through a bug proliferation simulation (the detailed mathematical formulas are given in Appendix |B| . 

The entropic IRSB solution takes into account both the energetic and the entropic effect and is numerically more 
involved. For the vertex-cover problem, following the entropic zero-temperature RS solution of Sec. IIII B[ we can 
develop the IRSB solution by defining the IRSB order parameter Qj\i{mj\i,rj\i). The iteration equation for Qj^^ 
reads: 



where nij^i and rj^^ are expressed by Eq. and Eq. (P5|) . 

When population dynamics is used to solve the entropic IRSB equation Eq. (|49)) . it is observed that, if the re- 
weighting parameter y is lower than certain threshold value, the magnitudes of some of the rj|j parameters may increase 
continuously with iteration and eventually diverge. This divergence suggest that the zero-temperature entropic IRSB 
solution is not stable. We use this divergence criterion to determine the type-II stability threshold of the zero- 
temperature entropic IRSB solution. 

Figure [5] shows the stability boundaries of the finite temperature IRSB solution, the energetic zero-temperature 
IRSB solution, and the zero-temperature entropic IRSB solution, for random regular graphs with K — 20 and K — 5. 
For both K = 20 and K = 5, the type-II stability threshold yjj and value y* (determined by S = 0) of the T ~ 
entropic IRSB solution match the corresponding slops in the T-m plane of the finite-temperature IRSB solution. At 
K = 20 the T = energetic IRSB solution has the same value of y* as that of the entropic IRSB solution; and the 
type-II stability threshold yjj of the energetic IRSB solution is very close to that of the entropic IRSB solution. 

The energetic IRSB solution is stable for y < yj. Since yi > y* at K = 20, the zero-temperature IRSB solutions 
at are type-I stable y — y* . However, yi < y* for K = 5, therefore the zero-temperature IRSB solutions are type-I 
unstable at y — y* . At this value of vertex connectivity, the type-II stability threshold yn as obtained for the IRSB 
energetic solution and the IRSB entropic solution are different. 



In summary, the vertex-cover problem on finite-connectivity random graphs were studied in this paper by finite- 
temperature cavity method at both the replica-symmetric and first-step replica-symmetry-breaking level, and the 
stability of these mean-field solutions were analyzed. We found that the local stability boundary Trs for the RS 
solution and the dynamical transition temperature Td show a re-entrant behavior with the connectivity both in the 
case of random regular graphs and Poisson random graphs: the threshold temperature Tus and Td first increases 
with connectivity and then decreases with connectivity. The reason for this re-entrant behavior (which is absent in 
the random Q-coloring problem [l^) is not yet clear. For random regular graphs with a relatively large connectivity 
(e.g., K — 20), there exists a temperature region in which both the RS solution and the IRSB solutions with 
Parisi parameter m close to unity are stable. This point deserves to be studied further on single graphs by the 
belief- propagation iteration process 0, [s^ using different initial conditions. At relatively large connectivity, the VC 
problem at not too low temperatures may be sufficiently described by the IRSB cavity solution without the need of 
further steps of replica-symmetry-breaking. But at temperature close to zero, more complicated mean-field solutions 
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APPENDIX A: CALCULATION OF THE DYNAMICAL TRANSITION TEMPERATURE Ta 

The dynamical transition temperature Td is defined as the highest temperature for the IRSB cavity equation at 
Parisi parameter m = 1 to have a non-trivial solution. To calculate T^, one may solve the IRSB equation Eq. ([57)1 with 




(49) 
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FIG. 8: (Color Online) Comparison of finite temperature results with the zero-temperature energetic and entropic IRSB 
results for regular random graphs of vertex degree is' = 20 (a) and K = 5 (b). Symbols are finite-temperature results. The 
blue dashed curve {yiT represent the slopes corresponding of type-I stability of the energetic zero temperature solutions. The 
energetic IRSB solution is type-I stable when y < yi. Black curves (dotted and dash dotted) represent the slopes corresponding 
to type-II stabihty of the (energetic and entropic) zero-temperature IRSB solution. The IRSB solution is type-II stable when 
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m = 1 using population dynamics, but numerically this is quite demanding, as population of populations is needed 
and different macrostates should be properly reweighted. It was first noticed in Ref. [28] that the IRSB equation at 
m = 1 may be solved without using populations of populations and reweighting of macrostates, and this possibility of 
simplification was exploited in various later studies [13, [H, [l^ [13, [1^ ■ In this appendix, we follow Ref. [l3| to solve 
Eq. dniD at y = /3 (i.e., m ^ 1). 

At m = 1 the mean cavity cover ratio ifj^i = J dT:j\iQj\i{T:j\i)'Kj\i satisfies the following iteration equation 

+ llkedj\i ^k\j 

which has the same form as the RS iteration equation Therefore, distribution of Wj^i among all the edges of the 
graph is given by Vrs, see Eq. ([12]). Define Q (ttItt) as the conditional probability that the cavity cover ratio is equal 
to TT when its mean value is 7f. We have 

Q {t^\t^) 'Prs (tt) 

= J VQViRSB [Q] Q{tt)s(w~ J dnQ (tt) tt 

k 



J2pnn{k + 1) / n dW,Vns{n,)S{w - Tns{{n,})) ^ i!} _ '-l^S{n - Tns{{nj})) (A2) 

fc=0 j = i ^ 



In deriving Eq. (jA2[) . we have used the identity that Qj{n\TT) = / T^Qj'PmsBiQjMQji'^), with VmsBiQjl'^) being 
the conditional probability of Qj given that the mean value of the cavity cover ratio is tt. ViRSBiQjlT^) is related to 
ViRSBiQj) by 

F,nsB{Q,\7r) - j T^Q^r,nsBiQ,)S{n - J dnQ,{7r)n) " Vnsin) ' ^""'^ 

To get rid of the reweighting term (e^^ + H'^'j) ^1- IIA2p . we define QajiT^jWj) as the conditional distribution 

j 

that the cavity cover ratio of vertex j is equal to nj given that the mean cavity cover ratio of vertex j is ttj and that 
vertex j is in the spin state Cj . We have 

VfT,(7rj|7rj) = = , (A4) 

where ipa-j = (1 ~ '^j)^<Tj,i + T^jSa-j.-i is the probability distribution of aj, and -ijj^^ — (1 — Tfj)Saj,i +T^jSaj.-i- Then 
Eq. (|A2[) can be rewritten as 



Q{TT\n)VRs{TT) = ^p„„(fc+l) Y[dnjVRs{7fj)S{Tf - TRs{{Tfj}) 
„ „ ScTi -le^^ + 5a, 1 T^jSa, -1 /"A 



From the above equation and the identity that 

Q(7r|^) = ^^,Q,(^|7f) , (A6) 

a 

we obtain an iterative equation for Qcr(^l^): 

oo p k 

IPaQa {tt\w) Vrs (7f) - ^ P„„(fc + 1) / n dWjVRs (tt,) S[W- Trs ({w^})] x 

fc=o i=i 

E , ^ i. ' X / nd^.Q.('r,l^.)'5['r-^«5(K})] . (A7) 
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According to Ref. ^2§\, the IRSB cavity equation Eq. ([57]) at m = 1 has a non-trivial fixed point if Eg. (jA7D has a 
non-trivial solution with the initial conditions Qi{t: — 0|7f) = 1 and Q_i(7r = l|7f) = 1, see also Refs. [ITI, [l9,. ,34. .35.]. 

APPENDIX B: ENERGETIC ZERO-TEMPERATURE STABILITY ANALYSIS 

In this section, bug proliferation is used to analyze the type-II instability of 1-RSB solutions in vertex-cover problems. 
We introduce an message, the so-called warning Uj-^i sent from vertex j to a neighbor i. If the vertex j is uncovered, 
it sends a warning Uj^i = 1 to i, otherwise Uj^i — 0. To do survey propagation, tt^j (t^^j) is used to represent the 



probability that vertex i is always uncovered (covered) when j is removed in a cluster. Similarly, t:^*^ is the probability 
that i is unfrozen in the above situation. 



]eN(i)\i feN{i)\{j,i} 

j6JV(i)\; 3&N{i)\i ]'eN(i)\{],i} 

c,|,=e-^[l-(l-e^) n (l-'^S^]- (B4) 

j€Nii)\l 

To analyze the type-II instability, a "bug" is introduced and propagated on a graph. Here "bug" means supposed 
that along edge 1 the warning is /3i, we turn it to another type like /3o with a very small probability After 
one iteration, this will induce a new "bug" 7 — > J on edge I as an output and the probability of this situation is: 

E {pl,^f,,---p"pJexp{~yAE') (B5) 

(/3o,--- ,/3„)^<5 

Thus we can define a matrix: 

"P 01^00 

The bug is propagated on the graph and if it can proliferate the system is unstable. After d times of iterations, 
absolutely the criterion of such an instability is determined by a product of d matrices 

C-\XMAx\=t^d (B7) 

where Xmax is the largest eigenvalue of matrix . . . V^. If p,d grows exponentially with d, the solution is unstable 
otherwise it is stable. Here the matrix V is simply just 2x2, 



(B8) 



It is easy to get that: 



e^nfceiv(i)w(l-'^S) 



l-(l-e^)n..^W\,(l--S) 
T. nfcgAr(i)\j,i(l-^i|]) 

1^1^0,0^1 = — TTvT l^^Uj 

i-(i-e^)n.,^w\,(i--S) 



and Vb^i.o^i = ^1^0,1-^0 = 0. 
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FIG. 9: Stability of the IRSB solution of random vertex-cover problem. In fid is plotted versus d for different y. From top to 
bottom: 2, 3, 3.3, 3.5, 3.55 and the lines are the linear fits. 

Solution about above equations and fid can be obtained through population dynamics. We have applied this analysis 
on the IRSB solution of the vertex-cover problem with mean vertex degree c = 10. The results are shovifn in the 
fig. [HI We estimate the threshold yn « 3.301. Considering that the grand free-energy density reaches the peak 
at y* = 3.13, we therefore conclude that thermodynamics of the energetic zero-temperature IRSB solution of the 
vertex-cover problem is unstable. 
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